Two-Sided Markov Chains

Empirical Bayes Estimation in Nonstationary Markov chains

Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical  Bayes estimators  for the transition probability  matrix of a finite nonstationary  Markov chain. The data are assumed to be of  a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...

Stochastic Resonance in Two-State Markov Chains

The notion of Stochastic Resonance appeared about twenty years ago in the works of Benzi et al. [1] and Nicolis [2] in the context of an attempt to explain the phenomenon of ice ages. The modern methods of acquiring and interpreting climate records indicate at least seven major climate changes in the last 700,000 years. These changes occurred with the periodicity of about 100, 000 years and are...

Stochastic Resonance in Two-State Markov Chains

two- sided power distribution

In this paper, a new family of distributions with many applications in financial engineering have been introduced. This distribution contains important statistical distributions such as the triangular, exponential and uniform distribution. Initially considered a special case of this distribution And then survey The important features of it. How to calculate maximum likelihood estimates are pres...

Markov chains

[Tip: Study the MC, QT, and Little's law lectures together: CTMC (MC lecture), M/M/1 queue (QT lecture), Little's law lecture (when deriving the mean response time from mean number of customers), DTMC (MC lecture), M/M/1 queue derivation using DTMC analysis, derive distribution of response time in M/M/1 queue (QT lecture), relation between Markov property and mem-oryless property (MC lecture), ...